Thought-based interaction: Same data, same methods, different results?

Restoration of communication in people with complete motor paralysis—a condition called complete locked-in state (CLIS)—is one of the greatest challenges of brain-computer interface (BCI) research. New findings have recently been presented that bring us one step closer to this goal. However, the validity of the evidence has been questioned: independent reanalysis of the same data yielded significantly different results. Reasons for the failure to replicate the findings must be of a methodological nature. What is the best practice to ensure that results are stringent and conclusive and analyses replicable? Confirmation bias and the counterintuitive nature of probability may lead to an overly optimistic interpretation of new evidence. Lack of detail complicates replicability

EEG-based endogenous online co-adaptive brain-computer interfaces: strategy for success?

A Brain-Computer Interface (BCI) translates patterns of brain signals such as the electroencephalogram (EEG) into messages for communication and control. In the case of endogenous systems the reliable detection of induced patterns is more challenging than the detection of the more stable and stereotypical evoked responses. In the former case specific mental activities such as motor imagery are used to encode different messages. In the latter case users have to attend sensory stimuli to evoke a characteristic response. Indeed, a large number of users who try to control endogenous BCIs do not reach sufficient level of accuracy. This fact is also known as BCI “inefficiency” or “illiteracy”. In this paper we discuss and make some conjectures, based on our knowledge and experience in BCI, on whether or not online co-adaptation of human and machine can be the solution to overcome this challenge. We point out some ingredients that might be necessary for the system to be reliable and allow the users to attain sufficient control.C. Vidaurre was supported by grant number RyC-2014-15671 of the Spanish MINECO

Temporal Coding of Brain Patterns for Direct Limb Control in Humans

For individuals with a high spinal cord injury (SCI) not only the lower limbs, but also the upper extremities are paralyzed. A neuroprosthesis can be used to restore the lost hand and arm function in those tetraplegics. The main problem for this group of individuals, however, is the reduced ability to voluntarily operate device controllers. A brain–computer interface provides a non-manual alternative to conventional input devices by translating brain activity patterns into control commands. We show that the temporal coding of individual mental imagery pattern can be used to control two independent degrees of freedom – grasp and elbow function – of an artificial robotic arm by utilizing a minimum number of EEG scalp electrodes. We describe the procedure from the initial screening to the final application. From eight naïve subjects participating online feedback experiments, four were able to voluntarily control an artificial arm by inducing one motor imagery pattern derived from one EEG derivation only

ECoG Beta Suppression and Modulation During Finger Extension and Flexion

Neural oscillations originate predominantly from interacting cortical neurons and consequently reflect aspects of cortical information processing. However, their functional role is not yet fully understood and their interpretation is debatable. Amplitude modulations (AMs) in alpha (8–12 Hz), beta (13–30 Hz), and high gamma (70–150 Hz) band in invasive electrocorticogram (ECoG) and non-invasive electroencephalogram (EEG) signals change with behavior. Alpha and beta band AMs are typically suppressed (desynchronized) during motor behavior, while high gamma AMs highly correlate with the behavior. These two phenomena are successfully used for functional brain mapping and brain-computer interface (BCI) applications. Recent research found movement-phase related AMs (MPA) also in high beta/low gamma (24–40 Hz) EEG rhythms. These MPAs were found by separating the suppressed AMs into sustained and dynamic components. Sustained AM components are those with frequencies that are lower than the motor behavior. Dynamic components those with frequencies higher than the behavior. In this paper, we study ECoG beta/low gamma band (12–30 Hz/30–42 Hz) AM during repetitive finger movements addressing the question whether or not MPAs can be found in ECoG beta band. Indeed, MPA in the 12–18 Hz and 18–24 Hz band were found. This additional information may lead to further improvements in ECoG-based prediction and reconstruction of motor behavior by combining high gamma AM and beta band MPA

The Self-Paced Graz Brain-Computer Interface: Methods and Applications

We present the self-paced 3-class Graz brain-computer interface (BCI) which is based on the detection of sensorimotor electroencephalogram (EEG) rhythms induced by motor imagery. Self-paced operation means that the BCI is able to determine whether the ongoing brain activity is intended as control signal (intentional control) or not (non-control state). The presented system is able to automatically reduce electrooculogram (EOG) artifacts, to detect electromyographic (EMG) activity, and uses only three bipolar EEG channels. Two applications are presented: the freeSpace virtual environment (VE) and the Brainloop interface. The freeSpace is a computer-game-like application where subjects have to navigate through the environment and collect coins by autonomously selecting navigation commands. Three subjects participated in these feedback experiments and each learned to navigate through the VE and collect coins. Two out of the three succeeded in collecting all three coins. The Brainloop interface provides an interface between the Graz-BCI and Google Earth

Post-adaptation effects in a motor imagery brain-computer interface online coadaptive paradigm

Online coadaptive training has been successfully employed to enable people to control motor imagery (MI)-based brain-computer interfaces (BCIs), allowing to completely skip the lengthy and demotivating open-loop calibration stage traditionally applied before closed-loop control. However, practical reasons may often dictate to eventually switch off decoder adaptation and proceed with BCI control under a fixed BCI model, a situation that remains rather unexplored. This work studies the existence and magnitude of potential post-adaptation effects on system performance, subject learning and brain signal modulation stability in a state-of-the-art, coadaptive training regime inspired by a game-like design. The results extracted in a cohort of 20 able-bodied individuals reveal that ceasing classifier adaptation after three runs (approx. 30 min) of a single-session training protocol had no significant impact on any of the examined BCI control and learning aspects in the remaining two runs (about 20 min) with a fixed classifier. Fifteen individuals achieved accuracies that are better than chance level and allowed them to successfully execute the given task. These findings alleviate a major concern regarding the applicability of coadaptive MI BCI training, thus helping to further establish this training approach and allow full exploitation of its benefits

Maths Anxiety and cognitive state monitoring for neuroadaptive learning systems using electroencephalography

Mathematical competence is important to acquire for everyday and professional purposes, but often represents a considerable hurdle for students, who may associate it with unpleasant experiences. Our goal is to use neuroscience and neural engineering to support students to improve their math- ematical understanding. More specifically, we are interested in the development of a non-invasive electroencephalogram (EEG)- based neuroadaptive Brain-Computer Interface (BCI) learning environment that optimizes learning outcomes by adapting the learning content provided according to the cognitive load of the learner. In this paper, we investigate what cognitive states occur when students with and without Math Anxiety learn to solve a math problem presented in the form of a novel computer puzzle. Results of an offline analysis of data recorded from 10 study participants suggest that different cognitive states occur, each with specific features that a BCI could potentially detect

Detecting System Errors in Virtual Reality Using EEG Through Error-Related Potentials

When persons interact with the environment and experience or wit-ness an error (e.g. an unexpected event), a specific brain pattern,known as error-related potential (ErrP) can be observed in the elec-troencephalographic signals (EEG). Virtual Reality (VR) technologyenables users to interact with computer-generated simulated envi-ronments and to provide multi-modal sensory feedback. Using VRsystems can, however, be error-prone. In this paper, we investigatethe presence of ErrPs when Virtual Reality users face 3 types ofvisualization errors: (Te) tracking errors when manipulating virtualobjects, (Fe) feedback errors, and (Be) background anomalies. Weconducted an experiment in which 15 participants were exposed tothe 3 types of errors while performing a center-out pick and placetask in virtual reality. The results showed that tracking errors gener-ate error-related potentials, the other types of errors did not generatesuch discernible patterns. In addition, we show that it is possible todetect the ErrPs generated by tracking losses in single trial, with anaccuracy of 85%. This constitutes a first step towards the automaticdetection of error-related potentials in VR applications, paving theway to the design of adaptive and self-corrective VR/AR applicationsby exploiting information directly from the user’s brain